COMBINATORIAL RULES FOR THREE BASES OF POLYNOMIALS 



COLLEEN ROSS AND ALEXANDER YONG 



(Ti ' 1. INTRODUCTION 

We present combinatorial rules (one theorem and two conjectures) concerning three 
^ ■ bases of Pol = Z[xi, x 2 , ■ . .]. 

& ■ Consider a basic question (studied for example in IIL13+II ): 

Mh ; 

How does one lift properties of the ring A of symmetric functions (and its 
Schur basis) to the entirety of Pol? 

The bases below lift the Schur polynomials. However, one wishes to analogize the rela- 
U: tionship in A between rules for Schur polynomials and Littlewood-Richardson rules. For 
^ | these bases, no rule has yet provided a parallel, explaining a desire for alternative forms. 

First, we prove a "splitting" rule for the basis of key polynomials {n a \® G Z,2? }, thereby 
establishing a new positivity theorem about them. This family was introduced by 



and first studied combinatorially in [LS89, LS90J. Combinatorial rules for their monomial 
expansion are known, see, e.g., | LS891 ILS901 [RS95 , HHLQ9J. Our rule refines |RS95, Theo- 
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rem 5(1)] and is compatible with the splitting rule [BKTY04, Corollary 3] for the basis of 

Schubert polynomials {& w \w G Soo}. 

Second, we investigate a basis {O a |o; G Z2? } defined by [L01| that deforms the key ba- 
psj \ sis. By extending the Kohnert moves of [K90J we conjecturally give the first combinatorial 
rule for the O-polynomials. 

Third, in [K90], the Kohnert moves were used to conjecture the first combinatorial rule 
for Schubert polynomials (a proof was later presented in I1W03I0 . Similarly, we use the 
extended Kohnert moves to give a conjecture for the basis of Grothendieck polynomials 
{<5 W \ w G Soo} HLS821 . This rule appears significantly different than earlier (proved) rules, 
such as those in IIFK941 ILOTI IBKTY051 lLRS^6l . 

1.1. Splitting key polynomials. Let be the group of permutations of N with finitely 
many non-fixed points. This acts on Pol by permuting the variables. Let s« be the simple 
transposition interchanging x { and x i+l . The divided difference operator acts on Pol by 

di = — . 

Define the Demazure operator by setting 

7r l (f) = d l (x l -f), for fe Pol. 

For a = (ai, a 2 , • • •) G Z2? , the key polynomial IS 

K a = x°^x% 2 ■ ■ ■ , if a is weakly decreasing. 
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Otherwise, 

K a = 7Tj(K S ) where « = (..., a i+1 , an, . . .) and a i+1 > a>i. 
Since the leading term of n a is x^x^ 2 ■ ■ ■ , the key polynomials form a Z-basis of Pol. 
The key polynomials lift the Schur polynomials: when 

(1) a = (cti, a 2 , ■ ■ ■ , a t , 0, 0,0,...), where ai < a 2 < ■ ■ ■ < a t , then 

(2) K a S( Qt ... , Q2 ,ai) (*^1 j • • • ) 2<t) ■ 

A descent of a is an index i such that > a i+1 ; a strict descent is an index i such that 
ai > a i+ i. Fix descents d\ < d 2 < . . . < d k of a containing all strict descents of a. Since 7Tj 
symmetrizes {xj, k q is separately symmetric in each collection: 

Xi = {xi , X 2 , . . . , X dl },X 2 = {x d },..., X fc = {x d ^ 1 + i,X dfc _ 1+2 ,...,X d J. 

(The variables x dk+1 , x dk+2) ■ ■ ■ do not appear in n a .) Therefore, uniquely: 

(3) K a (X) = ^,...,A^Ai(^l)"--^(X fc ) ) 

A!,...,A fe 

where each \ l is a partition. A priori one only knows £{\ xk G Z. 

Given a G ZS? , there is a unique u>[a] G S'oo such that code (w [a]) = a (see, e.g., MMOli 
Proposition 2.1.2]). Here code(u>[a]) G Z2? counts the number of boxes in columns of 
Rothe(u>[a]). We will need a special tableau coming from [S84, Section 4]: 

The tableau T[a\. Given w[a], i\ < i 2 < ... < i a in the first column of T [a] are given by hav- 
ing ij be the largest descent position smaller than in the permutation ws ia s ia _ 1 ■ ■ ■ s ij+1 . 
The next column of T[a] is similarly determined, starting from ws ia ■ ■ ■ s iir etc. 

An increasing tableau T of shape A is a filling with strictly increasing rows and columns. 
(In fact, T[a] is an increasing tableau.) Let row(T) be the reading word of T, obtained by 
reading the entries of T along rows, from right to left, and from top to bottom. Let min(T) 
be the smallest label in T. Finally, given a reduced word a = aia 2 . . . a m , let EGLS(a) be the 
output of the Edelman-Greene correspondence (see Section 2.1). 

The following result shows E" x X k e ^>o- ^ * s analogous to one on Schubert polyno- 
mials [BKTY04, Corollary 3] (which our proof uses). 

Theorem 1.1. The number £^ xk counts sequences of increasing tableaux (2i,T 2 , . . . , T k ) where 

• Ti is of shape \ l ; 

• min T\ > 0, min T 2 > d\, min T 3 > d 2 , . . . , min T k > dk-i', and 

• row(Tx) • row(T 2 ) • • • row(T fc ) is a reduced word ofw[a] such that 
EGLS(row(T!) ■ row(T 2 ) ■ • • row(Tfc)) = T[a\. 

When dj = j for all j > 1, Theorem 11.11 specializes to an instance of the monomial 
expansion formula [RS95, Theorem 5(1)] for K a (restated as Theorem 12.51 below). Also, 
when flD holds, k = 1, di = t and thus Theorem 11.11 gives ©. 

Example 1.2. The (strict) descents of a = (1,3, 0, 2, 2, 1) are d 1 = 2, d 2 = 5, and 

^1,3,0,2,2,1 — s 3,2(^l) ^2)52,1,1(^35 x 4,i X5) + S3^ 2 (Xi,X 2 )s 2) i(Xs, X4, X^)Si(xq) 

+ s 3i i(xi, x 2 )s 2y2 (x 3 , x i} x 5 )sx(xe) + s 3tl (x 1 ,x 2 )s 2X1 (x 3 , x 4 , x 5 ). 
exhibits the claimed non-negativity of Theorem ll.il 
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Also, w[a] = 2516743 (one line notation) and T[a) 



S, 



(1,3,0,2,2,1) 
(3,2),(2,1),(1) 

/ 



^(1,3,0,2,2,1) 
fc (3,l),(2,2),(l) 

\ 



s, 



(1,3,0,2,2,1) 
(3,1), (2, 2,1), 
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For example, for the leftmost sequence, EGLS(43152 ■ 6456 • 0) = T[a\ holds. 



□ 



1.2. The polynomials. A. Lascoux IIL011 defines Vt a for a = a 2 , . . .) G Z5? by re- 
placing 7Tj in the definition of the key polynomials with the operator defined by 



The initial condition is Q r 



7Tj(/) = di(Xi(l - X i+1 )f). 

'= k q ), if ex is weakly decreasing. 



™«1 Q2 „«3 
1 2 3 



The skyline diagram is Skyline(a;) = {(i,y) : 1 < y < C N 2 . Graphically, it is a 
collection of columns a;j high. For instance, 



Skyline(l,3,0,2,2, 1) 




Beginning with Skyline(o;), Kohnert's rule [K90J generates diagrams -Dby sequentially 
moving any + at the top of its column to the rightmost open position in its row and to its 
left. (The result of such a move need not be the skyline of any 7 e Z5? .) Let x D = Yl i 
be the column weight where di is the number of +'s in column i of D. If the same D 
results from a different sequence of moves, it only counts once. Kohnert's theorem states 
n a = x ° , where the sum is over all such D. Extending this, we introduce: 

The A'-Kohnert rule: Each + either moves as in Kohnert's rule, or stays in place and 
moves. In the latter case, mark the original position with a " g" . The g's are unmovable, 
but a given + treats g the same as other +'s when deciding if it can move, and to where. 
Diagrams with the same occupied positions but different arrangements of +'s and g's are 
counted separately. 



Example 1.3. Below, we give all A-Kohnert moves one step from D: 



D 



9 + 
+ + 



1 ^ 



9 + 
+ + + 



+ • 9 + 
+ 9 + + " : 



Let 



+ + 9 9 ■) + ■ 9 + 
• + + + +/' 1+ + + + • 



jW) = /? (# #' s a pp earin g in D ) X D . 



- + 9 ■ 
+ + + - 

• 9 + 
' V+ + + + 9, 



Conjecture 1.4. Ja ^ = 



3 



Conjecture II .41 has been checked by computer, for a wide range of cases up to a being 
of size 12, leaving us convinced. Clearly, Ja^ = K a , by Kohnert's theorem. 

Example 1.5. Let a = (1, 0, 2). Then the diagrams contributing to J(i,q,2) are: 



Skyline(l,0,2) 



+ 



+ 



+ 



+ . + 



+ 



9 
+ . 

Thus 



9 

+ + 



+ + g r \+ + 9 



+ 9 
+ . + 



<^(l,0,2) = (^1^3 + XiX 2 X 3 + x\x$ + x\x 2 + Xix\) 



— {X1X2X3 + x\x\ + X\X2X 3 + X1X2X3 + X1X2X3 + X1X3) + [x^X^Xs + x\x 2 x% ) ). 

The lowest degree homogeneous component of £l a is n a . Hence any / G Pol is a possibly 
infinite linear combination of the Vt a 's. Finiteness is asserted in IIL13+1 Chapter 5]. We 
show in Section 4.2 that the J a 's also form a (finite) basis. 



+ 



9 

+ + 



„2 2 



9 9 
+ ■ + 



1.3. Grothendieck polynomials. The Grothendieck polynomial [LS82] is defined using 
the isobaric divided difference operator whose action on / e Pol is given by: 



Declare <£> WQ (X) 



„n—ln—2 
X 9 



.? 1 



• • -x n _i where u> is the long element in S n . Set 



7Ti(^«;sJ if i is an ascent of w. The Grothendieck polynomials are known to lift {s x } to Pol. 

One has <S W = & w + (higher degree terms). We now state the A. Kohnert's conjecture 
|K90] for & w . The Rothe diagram is Rothe (w) = {(x,y)\y < w(x) and x < w^ 1 (y)} C 
[n] x [n] (indexed so that the southwest corner is labeled (1, 1)). Starting with Rothe (w), 
the Kohnert's rule generates diagrams D by applying the same rules as described for his 
rule for K a . Then & w = x D ) the sum is over all such D. 

Analogously, we define 

K W) - ^ (3^ 9 ' s a PP earin § in D ) X D 



D 



where the sum is over all diagrams D generated by the K-Kohnert rule. For example, if 
w = 3142 the diagrams contributing to K.£' are 

/. . . \ /. . . \ /. . . \ 



Rothe(3142) = 

and hence correspondingly, K^H 
Conjecture 1.6. Kw~^ = & w . 



+ 



+ + . 



+ + 9 ■ 
V+ ■ ■ ; 



{x\xz + x\x 2 ) 



(x\x 2 xz). 



Note, Kw = & w is precisely Kohnert's conjecture. Conjecture |1.6| has been checked by 
computer for n < 7, and extensively for larger n. While Kohnert's rule for & w is handy, it 
remains mysterious, even after (W03]. Conjectures |1.4| and |1.6| return to Kohnert's conjec- 
ture (albeit with a parameter /?). 
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2. Proof of Theorem HJJ 

2.1. Reduced word combinatorics. Given w 6 S n , let 

a = (ai,a 2 , ■ ■ ■ a e{w) ) and i = {ii,i 2 , ■ ■ -,H(w))- 

In connection to |BJS93j, we say the pair (a, i) is a stable compatible pair for w if s ai ■ • ■ s 0< . . 
is a reduced word for w and the following two conditions on i hold: 

(cs.l) 1 < ii < i 2 < ■ ■ ■ < k{ w ) < n; 
(cs.2) a,j < cij + i ==>- ij < ij+i. 

We will identify w with a and the associated reduced word. 

The Edelman-Greene correspondence [EG87J (the same basic construction is used in 
ILS82J) is a bijection 

EGLS : (a, i) \-> (T, U) 

where 

• T is an increasing tableau such that row(T) is a reduced word for a; and 

• U is a semistandard tableau whose multiset of labels is precisely those in i, and 
which has the same shape as T. 

EGLS (column) insertion: Initially insert a, into the leftmost column (of what will be T). If 
there are no labels strictly larger than aj, we place cij at the bottom of that column. If cij + 1 
for t > 2 appears, we bump this aj +tto the next column to the right, replacing it with aj. 
The same holds if aj + 1 appears but not aj. Finally, if both aj + 1 and a, already appear, 
we insert aj + 1 into the next column to the right. Since a is assumed to be reduced, the 
above enumerates all possibilities. Finally at step j a new box is created at a corner; in 
what will be U we place ij . 

Mildly abusing terminology, let EGLS (a) = T. 

2.2. Formulas for Schubert polynomials. A stable compatible pair (a, i) is a compatible 
pair for to if in addition to (cs.l) and (cs.2) the following holds: 

(cs.3) ij < dj. 



Let Compatible (w) be the set of compatible sequences for w. A rule of [BJS93] states: 

(4) e w (x)= 

(a,i)£Compatible(ui) 

A descent of w is an index j such that w(j) > w(j + 1). Let Descents (to) be the set of 
descents of w. The following is [BKTY04, Corollary 3]: 

Theorem 2.1. Let w e S n and suppose Descents (w) C {d\ < d 2 < ■ ■ ■ < d k }. Then 

(5) e w (x)= Yl c w xl _ xkSx ,(x l )---s xk (x k ) 

\ l ,...,X k 

where c xl xk counts the number of tuples of increasing tableaux (T x , . . . , T k ) where 

(i) Ti has shape X 1 ; 

(ii) min T\ > 0, min T 2 > d%, . . . , min T k > d k -i', and 

(iii) row(Ti) • • ■ row(T fc ) is a reduced word of w. 



Assume for the remainder of the proof that 

(6) Descents (w) C {di < d 2 < . . . < d k }- 
Let 

TuplesH = {[(21, U x ), (T 2 , U 2 ), (T k , U k )}} 

where the T/s satisfy (i), (ii) and (iii) from Theorem 12.11 and each Ui is a semistandard 
tableau of shape X 1 using the labels di-\ + 1, di-\ + 2, . . . , di (d = 0). 

2.3. "Splitting" the EGLS correspondence. Assuming ^ we define: 

$ : Compatible (u;) — > Tuples^). 

Description of $ (using EGLS): Uniquely split (a, i) G Compatible as follows 

(7) ((a«,i«),(a( 2 ) ) i( 2 )),---,(a«,i«)) 
where 

• a = a^ • • ■ a( fc ) and i = iW ■ ■ ■ ("• ■ • " means concatenation); and 

• the entries of are contained in the set {rfj-i + 1, <i,-i + 2, • • ■ , dj}. 

Now define 

$((a,i)) := (EGLS(a« !«),-•• , EGLS(a^, i (fe) )) . 
Proposition 2.2. The map $ : Compatible (w) — > Tuples (w) is well-defined and a bijection. 

Proof. $ is well-defined: The condition (i) is just says 2} and Uj have the same shape, which 
is true by EGLS's description. For (ii), the splitting says each label in iy) is strictly bigger 
than g?j_l. Now by (cs.3), each label in a^ is strictly bigger than dj_i as well. By EGLS's 
definition, the set of labels appearing in 2} is the same as that of a^; hence (ii) holds. 
Lastly, row(Tj) is a reduced word for Then (iii) is clear. 

$ is a bijection: Since EGLS is a bijective correspondence, clearly $ is an injection. Con- 
sider the weight function on Compatible (w) that assigns (a, i) weight x 1 and assigns 
[(2\, Ui), . . . , (Tk, Uk)} the weight x^ 1 • ■ ■ x. Uk , where x' 7, is the usual monomial associated 
to the tableau U{. Then clearly $ is a weight-preserving map (since EGLS is similarly 
weight-preserving). Hence the surjectivity of $ holds by dH) and Theorem 12.11 □ 

See ML041 Section 5] for a proof of Theorem 12.11 which is close to the study of the split 
EGLS correspondence (the argument constructs certain crystal operators). 

2.4. The tableau T[a]. Recall w[a] e satisfies code (w [a]) = a. Let -< be the pure 
reverse lexicographic total ordering on monomials. The Schubert polynomial & w [ a ] has 
leading term x a (with respect to -<). The same is true of n a (see [RS95, Corollary 7]) so 

(8) & w [a] = K a + linear combination of other key polynomials. 

Given an increasing tableau U, the nil left key K°(U) is defined by IE589I (cf. I1RS951 
p. 111-114]). Let sort (a) be the partition obtained by rearranging a into weakly decreas- 
ing order. Also let content (T) the usual content vector of a semistandard tableau T. This 
is a result of A. Lascoux-M.-R Schutzenberger (cf. [RS95, Theorem 4]): 
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Theorem 2.3. 

&w(X) = ^content (K°(U)) 

where the sum is over all increasing tableaux U of shape sort (a) with rov(U) = w. 

Thus, by © combined with Theorem 12.31 there exists a unique increasing tableau U[a] 
of shape sort (a) with row(Z7[a]) = w[ce] and such that a = content (K^_ (U[a\)). 

Let F w = lim fc _)>oo 6i* x ™ be the stable Schubert polynomial associated to w. This is a 
symmetric polynomial in infinitely many variables. So therefore one has an expansion 

(9) F w = y^a w ,A-SA, 

A 

where the a Wi \ G Z> are counted by increasing tableaux A of shape A with row(A) = w. 

In I1S841 Theorem 4.1], it is shown a w ^ w y = 1 for a certain explicitly described "max- 
imal" /i'(to). Moreover a simple description of the witnessing tableau A[a] is given. 
Straightforwardly, /i'(u>[a]) = sort(a). Then T[a] is precisely the witnessing tableau A[a] 
for a w [ a ] t x(w[a]) (after accounting for the fact that [S84J's conventions use F w [ a ] for what we 
call F w [ a ]-i). We leave the details to the reader. 

Finally, the expansion of Theorem 12.31 refines ©; see, e.g., [RS95J. Hence, T[a] = 
A[a] = U[a]. So, T[a] is an increasing tableau of shape sort [a] with row(T[a]) = w[a] 
and content(i ; r_(T[a;])) = a. 

2.5. Conclusion of the proof of Theorem ll.lt From the definition of Rothe(ty[a]): 
Lemma 2.4. The descents ofw[a] are contained in the set of descents d\ < d 2 < . . . < d k of 'a. 

Thus, 

(10) & w[a] (X) = J2* i = E c w ^[ xk s xl (Xi)---s xk (X k ). 

(a,i) A1,...,A* 

We recall a formula |RS95, Theorem 5]: 
Theorem 2.5. Fix an increasing tableau T with content (T)) = a. Then 

K a = ^ x' 

(a,i) 

where the sum is over compatible sequences (a, i) satisfying (cs.l), (cs.2), (cs.3) and EGLS(a) = T. 

Two reduced words a and a' for the same permutation are in the same Coxeter-Knuth 
class if EGLS(a) = EGLS(a') = T. This T represents the class. This equivalence relation ~ 
on reduced words is defined by the symmetric and transitive closure of the relations: 

(11) Ai(i + l)iB ~ A(i + l)i(« + l)B 

AacbB ~ AcabB 

AbacB ~ AbcaB 

where a < b < c. In particular, it is true that a ~ row(EGLS(a)). 

Restrict $ to those (a, i) e Compatible^ [a]) such that EGLS(a) = T[a\. Consider 
$(a, i) = [(Ti, Ux), . . . , (T fc , U k )\. Since EGLS(a^) ~ row(T, ; ), by dJ we see 

(12) row(Ti) • ■ ■ row(T fc ) ~ a (1) • • • a (/c) = a. 
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However, since we have assumed EGLS(a) = T[a], therefore: 

(13) EGLS(row(T!) ■ • • row(T fc )) = T[a], 

The other two requirements on (Ti, . . . , T k ) hold since $ is well-defined. 

Conversely, suppose [(Ti, £7i), . . . , (T k , Uk)} has (Ti, . . . , T k ) satisfying Theorem ll.lf s con- 
ditions. Since $ is a bijection, $ _1 ([(Ti, f/i), . . . , (r fc , f/fc)]) = (a, i) G Compatible(w[o;]). 
Also, by dH]), a ~ row(Ti) • • ■ row(T fc ). Now, we assumed (dU) holds. Hence, EGLS(a) = 
T[a] as desired. This completes the proof of the Theorem ll.il □ 

3. Additional remarks 

3.1. Comments on Theorem 11.11 Since K a specialize non-symmetric Macdonald polyno- 
mials (see, e.g., [HHL09, Section 5.3]), can one extend Theorem II .11 in that direction? 

Theorem 11.11 implies that the key module of [RS95, Section 5] should have an action of 
GL(di) x GL(d 2 — di) x • • • x GL(d k — <4-i) such that the character is K a . 

V. Reiner suggests a variation of Theorem 11.11 using the plactic theory. The derivation 
should be similar, using formulas from [RS94J. However we are missing the analogue of 
IIBKTY041 Corollary 4]; cf. IIKMS061 Sections 7, 8]. Theorem O naturally generalizes to 
Grothendieck polynomials, using [BKTY05, BKSTY08]; details may appear elsewhere. 



3.2. J a 's form a (finite) basis of Pol. Clearly, J a (X) = x a + Y^B^a c /3 x/? - One decomposes 
/ G Pol into a possibly infinite sum of J a 's: 

(14) f = Y,9* J « 

a 

That is, find the -< largest monomial x 6 * appearing in := / (say with coefficient cq q ) 
and let :— f — cq ■ Jg t . Thus only contains monomials strictly smaller in the -< 
ordering. Now repeat, defining /^ t+1 - ) := — cg t Jg t where x 61 ' is the -< -largest monomial 
appearing in etc. Since J a is not homogeneous, each step t potentially introduces 
-< -smaller monomials but of higher degree. However, we claim: 

Proposition 3.1. The expansion (flU is finite. 

Proof. By the K-Kohnert rule, each (5 that appears in J a is contained in the smallest rectan- 
gle R that contains a. So the above procedure only involves the finitely many diagrams 
contained in R for one of the finitely many initial a G Z2? such that x a is in /. □ 

3.3. More on the interplay of Grothendieck and the polynomials. M. Shimozono has 
suggested that the expansion of & w into £l a should alternate in sign, by degree. An explicit 
rule exhibiting this has been conjectured by V. Reiner and the second author. 
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